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Abstract 

Let G be a finite abelian group and E a subset of it. Suppose that we know for all subsets T 
of G of size up to k for how many x G G the translate x + T is contained in E. This information 
is collectively called the fc-deck of E. One can naturally extend the domain of definition of 
the fc-deck to include functions on G. Given the group G when is the fc-deck of a set in G 
sufficient to determine the set up to translation? The 2-deck is not sufficient (even when we 
allow for reflection of the set, which does not change the 2-deck) and the first interesting case is 
k = 3. We further restrict G to be cyclic and determine the values of n for which the 3-deck of a 
subset of 1 n is sufficient to determine the set up to translation. This completes the work begun 
by Griinbaum and Moore |GM| as far as the 3-deck is concerned. We additionally estimate 
from above the probability that for a random subset of Z n there exists another subset, not a 
translate of the first, with the same 3-deck. We give an exponentially small upper bound when 
the previously known one was 0(1/ \/ri). 

1 Introduction to the problem and results 

Let G be a finite abelian group, written additively, and / : G — > R be a function. For k > 2 we 
define the fc-deck or k-th order correlation of / as the function 

N ftk : G k ~ l -> R 

defined by 

Nf )k (xi, . . . , = ^2 f( x )f( x + x i) ■ ■ ■ f( x + x k-i)- (1) 

When ECG and fix) = xe( x ) is the indicator function of E we also write Ne k m place of Nt k . 
In this case, of / = xe, it is easy to see that the number NE,k(.%i,%2, ■ ■ ■ , ajjfc-i) is precisely the 
number of times the pattern 

0,x 1 ,...,x k -i 
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can be translated by an arbitrary element of G to be contained in E. In particular Ne,2 determines 
the difference multiset E — EoiE. The fc-deck may also be defined on an arbitrary locally compact 
abelian group, provided we replace the summation in the definition above with integration with 
respect to Haar measure. 

As our primary interest is in indicator functions, we will mainly consider nonnegative functions 
/. Another reason for considering only real functions is to avoid the extra complication due to the 
fact that the functions / and cjf have the same fe-deck whenever w is a fc-th root of unity. 

It is evident that the functions f{x) and ft(x) = f{x — t) have the same /c-decks for all values 
of k. The problem we discuss in this paper is the following: 

Is the function / : G — > M + determined up to translation if we know its /c-deck? 
What if the same question is asked for indicator functions? 

It is not hard to see that for k = 2, and even for indicator functions, the answer is negative. Indeed, 
suppose that we have two sets 4,B C G such that — B is not a translate of B and suppose also 
that the multisets E = A + B and F = A — B are actually sets. Take for example G = Zioi (the 
cyclic group of 101 elements), A = {0,10,20,30} and B = {0,1,3}. Then it is easy to see that 
the sets E and F have the same 2-deck but are not necessarily translates of each other, e.g. in the 
example we mentioned. 

In this paper we will restrict ourselves to finite cyclic groups and the emphasis will be on the 
3-deck or triple correlation. This problem is of significance in several fields of applied science, for 
example crystallography and signal processing jPetj . See also |JK| and the references therein. 

Our problem is most naturally studied with the use of the Fourier Transform on G, defined for 
any function / : G — > C as a function / on T, the group of characters of G (group homomorphisms 
into the multiplicative group {z £ C : \z\ = 1}), given by 

/(t) = E f(xh(d- 

In the particular case of interest to us when G = 7L n is the cyclic group of n elements then its dual 
group r is also isomorphic to Z n and the FT of / : Z n — ► C is a function / : 7L n —* C given by 

n-i 

f(k) = Y,fU)(n jk , k = 0,...,n-l, 

j=0 

where Cn = exp(2-7rz/n) is a primitive n-th root of unity. 

It is easy to see that the Fourier Transform of the function JV/ jt : G k ~ 1 — ► M + , the function 
A^fc . r k ~ l -> C, is given by 



A^i, •••,&-!) = /(6)---/tefc-i)/(6 + ••• + &-!) 

= /(a)-"-7(efe-l)/(-(6 + --- + 6-i)) since / is real. (2) 

This implies that 



In particular, if Nfk = N g ^ for two nonnegative functions / and g on G, we immediately get 
f(0) = g(0) by setting all £j = 0. It is also clear that Nt ^ = N g k for nonnegative / and g implies 
Nf^ r = Ng )T for all 2 < r < k — 1 as well, so that identity of the /c-decks implies the identity of all 
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lower order r-decks. Choosing £1 = —£2 = £ and = for jf > 3 we get /(£) = Note that 



if k is odd then we get 



= \g\ even for two arbitrary real functions / and g on G with Nf k = N g ^ 

if /(0) 7^ or g(0) 7^ 0. Furthermore, if k = 3 and if we know that / has no zeros on T it follows 
using ((2j) that the ratio f /g is a map from G to the unit circle which is a group homomorphism, 
and this is equivalent to the function / being a translate of the function g. 

This reveals the fact that the main difficulty in the study of this problem is the existence of 
zeros in the Fourier Transform of the function whose £>deck we know. Consider for example the 
case of the group G = Z p , p a prime. It is well known that the linear rank over Q of the set of 
p-th roots of unity is p — 1, and this implies that any non-trivial Q-linear combination of at most 
p — 1 such roots cannot vanish. In other words, if we have a non-constant function / : Z p — > Q 
(e.g. the indicator function of a non-trivial subset of Z p ), then its FT never vanishes on Z p (which 
is the dual group of itself). By the previous discussion then the 3-deck of any function / : Z p —* Q 
determines / up to translation |E,Slj . 

The question of whether Nf ^ determines / up to translation depends both on the group G on 
which / is defined as well as on assumed properties of /. The main cases of interest are when (a) / is 
any nonnegative function, (b) / is a rational-valued function, possibly restricted to be nonnegative, 
and (c) / is an indicator function. It is not hard to see, for instance, that on the group R there are, 
for every k, nonnegative functions which are not determined up to translation from their fc-deck 
|.TK| . The same question is open if one demands that / is an indicator function of set of finite 
measure although the answer is known to be positive in certain special cases of sets [JK]. On the 
other hand even the 3-deck determines a function / G L 1 (M) if it is of compact support |JK| . 

1.1 Previous results 

In the case of cyclic groups the most significant work is that of Griinbaum and Moore |GM| . This 
work seems largely to have gone unnoticed in the mathematical literature although it solves the 
most important cases of the problem for cyclic groups. This is probably due to the fact that it 
was published in a Crystallography journal. The following is a summary of the results in GM 
regarding reconstructing / on Z n from its /c-deck. Notice that in |G]VI| it is assumed at the outset 
that all functions to be reconstructed from their /c-deck have a non-zero sum over the group. 

1. For any n, if / and g are rational- valued functions on Z n with the same 6-deck then they are 
translates of each other |GM| Theorem 4]. 



2. If n is even and at least 30 then there are sets E, F C Z ra which have the same 3-deck but 
are not translates of each other [SHI §5.3]. 

3. If n is odd, / and g are rational-valued functions on Z n with the same 3-deck and f(l) 7^ 
then / and g are translates of each other |GMl Theorem 3]. This is heavily based on a result 
of Lenstra [C] (see our M2. lj) . 



4. For any n suppose that / is a rational- valued function on Z n and E C Z ra , g = \E- Then if / 
and g have the same 4-deck and f(l) 7^ it follows that / and g are translates of each other 
tMI Theorem 5]. It is sugg ested in G.\f| that the condition /(l) / may be unnecessary. 



5. There is no value of k such that for all n the equality of the /c-deck of two real functions / 
and g on Z n implies that they are translates of each other |GM| §8.2]. 
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6. If n = pqr, with p and q distinct primes, and r > 1 is an integer then there are two rational- 
valued functions / and g on 7L n which have the same 3-deck, satisfy /(l) = g(l) = 0, and are 
not translates of each other |GM1 §5.2]. 

Radcliffe and Scott |RS2| study the problem for infinite subsets of R which are subject to some 
sort of "local finiteness" and prove reconstructibility from the 3-deck. In |RS1| the same authors 
prove reconstructibility up to translation from the 3-deck in Z p , p a prime, show that almost all 
subsets of Z n are determined up to translation by their 3-deck and show that any set in Z n is 
determined up to translation by its /c-deck with k being 9 times the number of distinct prime 
factors of n. 

Pebody, Radcliffe and Scott |PB,S| study a variation of the problem. They prove that any finite 
subset E of the plane can be reconstructed up to rigid motion if one knows for any subset A of the 
plane of up to 18 points how many rigid-motion copies of A are to be found in E. 

Jaming and Kolountzakis |JK| study the problem both in the case of the group R and in cyclic 
groups. In the case of R it is pointed out that several conditions which guarantee some sort of 
analyticity of / are enough to imply that the 3-deck of / determines / up to translation. It is 
shown that for every k there exist two nonnegative, smooth f,g 6 L X (R) with the same /c-deck, 
which are not translates of each other. In fact for some such / there exist even uncountably many, 
translation inequivalent, functions g which have the same /c-deck as /. 

It is also proved in |.TK| that if E C R has finite measure, g G L 1 (R) is nonnegative and \e and 
g have the same 3-deck, then g is itself an indicator function. Although it is still an open problem 
whether any E C R of finite measure is determined up to translation from its 3-deck, it is proved 
in jJKj that if E is an open set with gaps bounded below (write E as a disjoint collection of open 
intervals and look at the gaps so defined) then E is determined from its 3-deck. 

In the case of the cyclic group Z n it is proved in |JK1 Theorem 3.1 and following Remark] 
that when n = p a , p a prime larger than 2, then the 3-deck of a set in Z n determines the set up 
to translation. It is also shown that if n = 2 a then the 4-deck of a set determines the set up to 
translation (and this is mistakenly attributed to |GM| ) . In jJKl Theorem 3.2] it is erroneously 
claimed that if n = pq with p and q two distinct primes then the 3-deck is enough to reconstruct 
a set in Z^. Given the results of |GM| summarized above, the condition p,q ^> 2 clearly needs to 
be added and then the theorem is correct. A corrected proof is given in our $2j The attempt, at 
the end of |JK| , to explain the examples given by Griinbaum and Moore for the case n = pqr (see 
summary above) is also erroneous. 

Pebody [Fj defines r(G) (resp. r se ^(G)) the minimum k such that the /c-deck of a nonnegative 
rational-valued function on G (resp. subset of G) determines the function (resp. set) up to trans- 
lation. Improving results for the cyclic group of Alon, Caro, Krasikov and Roditty |AGK R and 
Radcliffe and Scott |RSlj . Pebody, computes the number r(G) for all finite abelian G and his result 
implies r(Z n ) < 6. For the cyclic groups the result had already been proved in |GM| . In particular, 
Pebody gets that the 3-deck determines all nonnegative rational valued functions up to translation 
on the cyclic group Z n (n > 3) if and only if n is a power of an odd prime or the product of two 
odd primes. 

1.2 New results 

In 321 we complete the characterization of those finite cyclic groups in which the 3-deck determines 
any subset up to translation. We show that 

1. If n = p 2 q, with p and q distinct odd primes then any subset of Z n can be determined up to 
translation from its 3-deck (Theorem 12. 1|) . 
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2. The same is true if n = pqr, with p, q, r distinct odd primes (Theorem 12.1(1 . 

3. If n = pqrd, with p, q distinct primes and r,d > 1, then there are two subsets E and F of 7L n 
with the same 3-deck which are not translates of each other (Theorem 12 .23(1 . 

4. If n = 2k, k > 6, we give two subsets E and F of Z n , not translates of each other, which have 
the same 3-deck ( Theorem 12.22(1 . This result subsumes the above mentioned result of |GMj 
(for even n, n > 30) and, we think, our examples are much easier to understand. 

If n is even and at most 10 we show that there are no such examples (Proposition 12 . 2 Tjl . 

Thus we get the following. 

Corollary 1.1. Every subset of the cyclic group 7L n can be determined up to translation from its 3- 
deck if and only if n is a power of an odd prime or n is the product of at most three (not necessarily 
distinct) odd primes or n £ {2, 4, 6, 8, 10}. 

Remark 1.2. As we were finishing this paper we came across a manuscript by Pebody |P2j where 
the cases of odd n for which the 3-deck is sufficient are also determined. Our work was done 
independently and, apparently, almost simultaneously. 

Comparing Corollary 11.11 to the last mentioned special case of the result of Pebody [F| in the 
previous subsection, we observe that the analogous characterization of the "good" values of n is 
different if we consider nonnegative rational valued functions instead of subsets. 

Key to our results are theorems which significantly restrict the zero set of the Fourier Transform 
of indicator functions of subsets of certain cyclic groups. See for instance Lemma 12.181 

In 321 we study the number of subsets of Z n which are not determined by their 3-deck up to 
translation. In RSI Radcliffe and Scott had already shown that this number is 0(2 n /-y/n) as 
n — > oo. We show that this number is in fact much smaller, namely 0(2~ Cen E 2 n ), for any fixed 
e > (Theorem l3~l). 

2 For which cyclic groups the 3-deck determines a set up to trans- 
lation 

2.1 Positive results 

The main result of this subsection is the following: 

Theorem 2.1. Let n be a power of an odd prime or the product of at most three (not necessarily 
distinct) odd primes. Then every subset ofZ n is uniquely determined up to translation by its 3-deck. 

For completeness and because it needs no extra effort, our proof will cover not only the new 
results but also the known ones. We shall use only the same theorem of H. W. Lenstra that was 
used by Griinbaum and Moore in |GM| : 

Lenstra's Theorem L . If N is an odd integer, and m and N are coprime then there exists 
a finite sequence x\, ...,xi of relative primes to N such that x\ = 1, x\ = m and every member 
except the first is the sum or difference of two not necessarily different previous members of the 
sequence. 

As we saw in the Introduction, the 3-deck determines a nonnegative function up to translation 
if its Fourier Transform has no zero. We shall show that if n is a power of an odd prime or n is 
the product of at most three (not necessarily distinct) odd primes then the support of the Fourier 
Transform of a characteristic function on 7L n is always rich enough to get the same conclusion. Our 
method can be considered as a generalization of the methods in |GM| and |.TK| . 
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Definition 2.2. We say that A C Z n is an extendable domain if for every h : A — > R/Z additive 
(by which we mean that h(x + y) = h(x) + h(y) whenever x, y, x + y £ A) function there exists an 
L 6 R such that = Lk (mod 1) for every k £ A. 

Lemma 2.3. fij // / and g are nonnegative functions on Z n with the same 3-deck and supp/ is 
an extendable domain then f and g are translates of each other. 

(2) If f and g are real valued functions on Z n with the same 3-deck, /(0) / or g(0) ^ and 
supp / is an extendable domain then f and g are translates of each other. 

Proof. Suppose that / and g satisfy the conditions of (1) or (2). We saw in the Introduction that 
in these cases having the same 3-deck implies that / and g have the same modulus. Hence there 
exists a function h : supp / — ► R/Z such that g(l) = e 2nih ^f(l). Substituting this to © we get 
that h must be additive as defined in Definition 12.21 Then, since supp / is an extendable domain, h 
must be linear, thus e 2mh ^ is the restriction of a character to supp/, and so / and g are translates 
of each other. □ 

Therefore, to prove Theorem I2.1l it is enough to prove the following: 

Proposition 2.4. If n is a power of an odd prime or n is the product of at most three (not neces- 
sarily distinct) odd primes then the support of the Fourier Transform of a characteristic function 
on Z n is always an extendable domain. 

To prove this proposition we need several facts and lemmas, some of which may be known 
and/or interesting in themselves. The following five facts are surely known but for completeness, 
and because it is easier to prove them than to find them in the literature, we present their proofs. 

Notation 2.5. Let (k,l) denote the greatest common divisor of k and I. For a\n let 

{o) n = {k S Z n : (k,n) = a} and 
aZ n = jo, a, 2a, ... , ^ lj a | C Z n . 

Fact 2.6. If f : Z n — > Q then supp/ is the union of sets of the form (a) n (a\n). 

Proof. We can write f(k) = Y^=o /(i)C^ where Cn,k = e~ 2mk l n is the k-th. root of unity of order 
n. The right hand side is a rational polynomial evaluated at the roots of unity. It is well known 
that Cn,k is an algebraic conjugate of Cn,i over Q if and only if (n, k) = (n, I). □ 

Fact 2.7. For a\n a function f : Z n — > C is a-periodic if and only if supp / C ^Z n . 

Proof. The space of a-periodic functions on Z n has dimension a and it is clearly spanned by the 
characters xi(j) = e 2m ^ j , I = 0, 1, . . . , a - 1. □ 

Fact 2.8. For a function f : Z n — ► C we have supp / C aiZ n U . . . U a\JL n if and only if f can be 
written in the form / = /i + • • • + fk, where fj : Z n — > C is -^--periodic (j = 1, . . . , k). 

Proof. The splitting f = ^2fj ^ s accomplished by arbitrarily splitting f = fj> i n a wa y that fj 
is supported on aoZ n , inverting the Fourier Transform and using Fact [2^21 D 

Fact 2.9. If n is odd then any integer k can be written as k = a + b where (a,n) = (b,n) = 1. 
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Proof. We can clearly assume that n is squarefree; that is, it is of the form n = pi ■ ■ ■ p r , where 
Px, ■ ■ ■ ,p r are distinct primes. For each j = 1, . . . , r let aj = 2 and bj = — 1 if k = 1 (modpj) and let 
aj = 1 and b j = k — 1 otherwise. By the Chinese Remainder theorem there exist a and 6 such that 
a = aj (modpj) and b = bj (modpj) for j = 1, . . . ,r. Now a + b = k (modpj) for each j = 1, . . . , r, 
so a + 6 = (mod n) . By choosing a properly, by which we mean that we add a multiple of n to a 
if necessary, we can guarantee that a + b = k. Since each pj > 2, we have ay, 6j ^ (modpj), so 
(o,n) = (b,n) = 1. □ 

Fact 2.10. If there are two equivalence relations on a set such that both contain at least two classes 
then there exist two elements which are inequivalent w.r.t. both relations. 

Proof. If not then any two elements which are inequivalent w.r.t. the first relation should be equiv- 
alent w.r.t. the second. This easily implies that there is only one equivalence class w.r.t. the second 
relation, a contradiction. □ 

Lemma 2.11. If a is a divisor of the odd n and {a) n C A C aL n then A is an extendable domain. 

Proof. Let h : A — > R/Z be an additive function. It is enough to prove that 

m £ Z, ma £ A ==>- h(ma) = mh(a) (mod 1), (4) 

since then for any L £ R such that h(a) = La (mod 1) we get that h(ma) = mh(a) = Lma (mod 1), 
which is exactly what we want to show. 

Let N = n/a. Note that ma £ (a) n holds if and only if m and iV are coprime. Using the 
previously stated Lenstra's Theorem for N = n/a and an m such that m and iV are coprime we get 
a sequence x\, . . . ,xi of relative primes to N such that x\ = 1, X\ = m and every member except 
the first is the sum or difference of two not necessarily different previous members of the sequence. 
Note that, since X{ and n/a are coprime, xia £ (a) n C A for each i. Then by induction we get that 
h{xia) = Xih(a), and so (jlj) holds whenever m and n/a are coprime. Then (jlj) in the general case 
follows by using Fact 12.91 □ 

Corollary 2.12. If n is odd, f : Z n — > Q and a £ supp/ C aZ n then supp/ is an extendable 
domain. 

In particular, the following two statements hold: 

(i) If n is odd, f : Z n — ► Q and f(l) ^ then supp / is an extendable domain. 

(ii) If n is a power of an odd prime and f : 7L n — > Q then supp/ is an extendable domain. 

Proof. The first statement follows immediately from Lemma 12 . 1 1 1 and Fact 12 .fil If a = 1 then we 
get (i). Statement (ii) is also a special case of the first statement since if n = p k and I is minimal 
such that p l £ supp / then p l £ supp / C p z Z n . □ 

Lemma 2.13. If xe = fa + fb> an d fa a nd fb are periodic Z — * C functions with coprime periods 
a and b then \E is periodic with period a or b. 

Proof. Using the periodicity and \E = fa + fb, for any k, n, I £ N we get 

f b (ak + bn + l) = f b (ak + I) = X E(ak + I) - f a (ak + I) = X E(ak + I) - f a (l). (5) 

Since a and b are coprime, for any fixed I £ Z every integer can be written in the form ak + bn + l. 
Thus (JSJ) implies that for any fixed I £ Z the range of fb is a subset of {—f a (l), 1 — f a (l)}- This 
implies that f a or fb must be constant on Z. □ 
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Lemma 2.14. Suppose that a and b are divisors of n, n/a and n/b are coprime, E C Z ra , and 
suppxs C aZ ra U VL n . Then suppxi; C aZ n or suppx^ C b7L n . 

Proof. By Fact 12.81 suppxi C aZ„ U 6Z n implies the existence of an n/a-periodic function / and 
an n/b periodic function g such that xe = f + 9- Since n/a and n/b are coprime, by Lemma 12.131 
we get that xe must be n/a-periodic or n/b periodic. By Fact 12.71 this implies that suppxi; C aZ n 
or suppxe C bZ n . □ 

Lemma 2.15. Suppose that a and b (XTG copviffiG divisovs of E CZ Z nj 

supp£e C (aZ n U VL n \ aUL n ) U {0}. 
Then supp x~E C aL n or supp xe C &Z n . 

Proof. Let c = ^ . By Fact 12.81 supp xe C aZ n U 6Z n implies that x.E can be written in the form 
Xe = fa + /&, where / a is 6c-periodic and /& is ac-periodic. Applying Lemma T2.13I we get that for 
each t = 0, 1, . . . ,p — 1 the function XE^kc + t) is a-periodic or 6-periodic. Let mt be the number 
of points of the form kc + t in E. Then 



m t £ {0, 1, . . . , ab} is divisible by a or b; 

by a if XE(kc + i) is 6-periodic and by b if XE(kc + i) is a-periodic. (6) 

A straightforward calculation shows that for any s £ Z 

c-1 . 

^ ^ — -\ / litis \ c 

XE{sab) = 2^m t [e c J . 
t=o 

Since we assumed that xe(sa6) = for s = 1, . . . , c— 1, we get that the c— 1 c-th roots of unity e~^~ 
(s = 1, . . . , c— 1) are all roots of the (c— l)-th order polynomial Ylt=o m t zt ■ Hence Ylt=o m t z * must 
be a constant multiple of 11^"^ (2; — e~~^) = Ylt=o z * an< ^ so all m t must be the same. Using © and 
that a and b are coprime this implies that XE(kc + t) is a-periodic for each t or ^-periodic for each 
t. Thus xe is ac-periodic or ftc-periodic hence, by Fact 12.71 suppxe C aL n or suppxi; C bZ n . □ 

Lemma 2.16. //a and b are coprime divisors of the odd n and (a) n U (b) n U{ab} C A C aZ n U6Z n 
i/ten A is an extendable domain. 

Proof. Let n : A — > R/Z be an additive function. We have to find an L £ R such that n(/c) = Lfc 
(mod 1) for every 6 i. 

By Lemma 12.111 yl n aZ n and A n &Z n are extendable domains, so there exist L a and such 
that 

h(k) = L a k (mod 1) if A; £ ,4 n aZ n , and = L b k (mod 1) iffc£AnoZ n . (7) 

Note that for any u, v £ Z, L a can be replaced by L a + - and can be replaced by Lb + | in (jJJ). 
Thus it is enough to find u, v £ Z such that L a + ^ = Lf, + ¥, which is equivalent to 

ub — va = L a ab — L^ab. (8) 

Using ab £ A and 0, we get L a o& = h(ab) = L^ab (mod 1), so L a ab — L b ab £ Z. Then, since a 
and b are coprime, there exists u, v £ Z for which © holds, which completes the proof. □ 
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In the sequel we shall use Fact 12.61 in the proofs many times without explicitly citing it. 

Lemma 2.17. Let the odd n = pqd, where p and q are two distinct primes, and d is a prime or 
d = 1. If ' E CZ„ and suppx~E C f?Z n U qL n then suppxi; is an extendable domain. 

Proof. If p, q G suppx~E then, applying Lemma ?2. 151 for a = p, b = q, we get that supp x~E H pq1> n 7^ 
{0}, which implies that pq G suppxi;. Then we can apply Lemma [2.161 to get that suppx~E is 
indeed an extendable domain. 

So we can suppose by symmetry that q G" suppxl?. Then suppx~E C pZ n U gZ n implies that 
suppxs C pZ, n U qdZ n . Then, in case of d / p by Lemma \l. 141 in case of d = p clearly, we have 

suppxi C pZ n or suppxi C qdZ n . 

If suppx^ C qdTL n then suppx~E = (qd) n U{0} or suppxi; = {0}, so we are done by Lemma r2.HI 
So we can suppose that {0} ^ suppx~E C pZ n . If p G suppxi; then by Corollary 12 . 1 21 supp ytp. 
is an extendable domain, so we can suppose that p G" suppxE- Then, by Fact 12.61 suppxe can be 
only (pd) n U {0} or (pq) n U {0} or {pq) n U (pd) n U {0} with d ^ 1, q. The last case is impossible by 
Lemma 12.141 (for a = pq,b = pd), while in the first two cases Lemma 12 . 1 1 1 implies that suppx^: is 
an extendable domain. □ 

The following lemma about the possible support of the Fourier Transform of characteristic 
functions on Z n is the key for handling the hardest case when n is the product of three distinct 
primes. This statement might be useful in other applications, too. 

Lemma 2.18. Suppose p,q and r are pairwise coprime, but not necessarily primes. Let n = pqr 
and let E C Z n . Then 

p,q£ suppxi C pZ n U qZ n U rZ n =>■ (3z G {1, 2, . . . , r - 1}) zpq G supple- 

Proof. Suppose that for each z = 1, 2, . . . , r — 1 we have 

r —lpq— l r—l /pg—1 \ 

= XE(zpq) = 2^ 2^ XE(kr + c)e ^ = 2^ 2_^ XfiCfcr + c ) ( e ~ ""J • 

c=0 A:=0 c=0 \fc=0 / 

This implies that Y^k=o XE{kr + c) must be the same for each c G Z r ; that is, 
pg-l 

^ XE (kr + ci) - xeO + c 2 ) = (ci,c 2 GZ r ). (9) 

k=0 

For each j G Z n (n = pqr) let (a,-, 6j, Cj) G Z p x Z g x Z r be the unique triple such that 

j = aj mod p, j = bj mod q and j = Cj mod r, 

and let <p be the inverse of the above Z n — > Z p x Z g x Z r bijections; that is, </>(a, 6, c) (a G Z p , 6 G 
Z g , c G Z r ) is the unique element of Z n for which 

4>(a,b,c) = a modp, 4>(a,b, c) = b mod q and 0(o, b, c) = c modr. 

Since supp xe C pZ n U gZ n U rZ n , xe can be written as x.E = f + g + h, where / is gr-periodic, 
g is pr periodic and h is pq-periodic. 

Since / is (jr-periodic, f(<ft(a, b, c)) does not depend on a, so f o <f> can be written in the form 
f(4>(a,b,c)) = F(b,c). Similarly g o <fi and h o <f> can be written as g(4>(a,b, cj) = G(a,c) and 
h(4>(a, b, c)) = H(a, b). So using the notation E' = <p~ l {E) C Z p x 7L q x Z r we get that 

Xe'(o, b, c) = F(b, c) + G(a, c) + H(a, b) a G Z p , 6 G Z 9 , c G Z r . 
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We claim that there exist c\,C2 G Z r such that neither the 7* q — > M function jP(- , ci) — , C2), 
nor the Z p — > M function G(- , ci) — G(- , c 2 ) is constant. Indeed, F(- , ci) — F(- , c 2 ) being constant 
defines an equivalence relation on Z r and so does G(- , c%) — G(- , c 2 ) being constant. If there is only 
one equivalence class w.r.t. the first relation then F can be written as F(b,c) = u(b) + v(c) which 
implies 

XeU) = XE'(aj,bj,Cj) = v(cj) + G{a j ,c j ) +u(bj) +H(a,j,bj), 

and this would in turn imply x~e(p) = 0) contradicting our assumption. Hence there are at least 
two classes w.r.t. the first relation. Similarly there are two classes w.r.t. the second relation and 
using Fact 12.10*1 we obtain our claim. 
On the other hand, since 

(F(b, ci) - F(b, c 2 )) + (G(a, d) - G(a, c 2 )) = XE'{a, b, a) - X E>(a, b, c 2 ) G {-1, 0, 1} 

for any a G Z p , b G Z 9 , we have 

Range(F(- , c x ) - F(- , c 2 )) + Range(G(- , c x ) - G(- , c 2 )) C {-1, 0, 1}. 

Since by the previous paragraph Range(-F(- , c\) — F(-C2)) and Range(G(- , c\) — G{- ,c 2 )) have at 
least two elements, this implies that they must be of the form 

Range(F(- , ci) - F(- , c 2 )) = {A,A + 1}, 

Range(G(- , ci) - G(- , c 2 )) = {-A, -A - 1} 

for some AgR. 

Let l\ G {1, . . . , q — 1} be the number of elements b £ Z q for which F(b, c\) — F(b, C2)) = ^4 and 
?2 G {1, . . . ,p — 1} be the number of elements a G Z p for which G(a, ci) — G(a, c 2 )) = —A 
Then, combining this with (J""J) we get 

pg-l 

= ^ XE(kr + ci) - Xg(fcr + c 2 ) 
fc=o 

= X] Xs'( a ' & ' c i) ~ XE'{a,b,c 2 ) 

a£Z p b£Z q 

= phA+p(q - h)(A + 1) + ql 2 (-A) + q(p - l 2 )(-A - 1) 
= -hp + hq, 

which is a contradiction since hp cannot be divisible by q. □ 

Lemma 2.19. Let n = pqr with p,q,r three distinct primes, E C Z n . Then 

p,q,r G supp x~E C pL n U gZ„ U rZ„ => supp £e = pZ n U gZ n U rZ n . 

Proof. Suppose that p,q,r G supple C pZ„ U q7L n U rZ n . By Lemma 12.181 we have (pq) n U 
(pr) n U (?r) n C suppx~E- Since E cannot be empty, (pqr) n C suppx^. Since p7L n U gZ n U gZ n = 
{p)n U (g) n U (r) n U (pq) n U (pr}„ U (qr) n U (pqr) n , this completes the proof. □ 

Lemma 2.20. // a,b,c G Z are pairwise coprime then aL n U 6Z n U cZ n is an extendable domain. 
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Proof. Let A = aZ n U &Z ra U cZ n and let h : A — ► M/Z be additive. Then it is easy to show that for 
a = h(a)/a,f3 = h(b)/b,j = h(c)/c we have 

h(ma) = ama, h(mb) = (3mb, h(mc) = jmc (modi) (m E Z). (10) 

It is enough to find u,v,w G Z such that 

a + -=/3 + -=7 + - 11) 
a b c 

since then /i(x) = Lx (mod 1) would follow forL = a + ^ = /3+|=7 + ^ from (fTU|) . 
For v £ Z there exist it and u> such that 1)11(1 holds if 

fa = aab — j3ab (mod 6) and vc = 76c — (3bc (mod 6), 

which hold for some v £ Z if and only if 

uab — fiab£7L, 76c — /36c S Z and c(aab — f3ab) = a(-jbc — 0bc) (mod 6). (12) 

Using (|TU|) for m = a, b, c we get that 

aab = flab, [3bc = jbc and aac = (3ac (modi), 

which implies 1)12)1 and so completes the proof. □ 

Proof. (Proposition 12.4(1 By Corollary 12.121 we are done if n is a power of an odd prime or if 
1 S suppx^. So we can suppose that 1 suppxi; and n = pqr, where p and q are different primes 
and r is a prime or r = 1. If r = 1 or r = p or r = q then n equals pq or p 2 g or pq 2 and so 
1 suppxi implies that suppxi? C pZ„ U gZ„, hence we are done by Lemma \2. 171 

Therefore we can suppose that 1 suppxi; and n = pqr, where p, q and r are distinct primes. 
Then we have suppxs C p7L n U gZ n U rZ n . 

If p,q,r £ suppxi? then, by Lemma f2.19( we have suppxi; = p7L n U q7L n U rZ ra , which is an 
extendable domain by Lemma I2.2UI 

Otherwise, we can suppose by symmetry that r suppx^ and so suppx^ C p7L n U gZ ra . Then 
we are done by Lemma 12.171 

This completes the proof of Proposition 12.41 and so also the proof of Theorem 12.11 □ 

If n is even then we get positive results for small n: 

Proposition 2.21. For n = 2,4,6,8 and 10 every subset of Z n is uniquely determined up to 
translations by its 3-deck. 

For n = 2, 4 and 6 this statement follows very easily from the definition of 3-deck. For both 
n = 8 and n = 10 one can provide proofs using the lemmas and the method of this section. However, 
in these cases there are only 2 8 and 2 10 subsets of Z n , so one can easily check (and we indeed did 
check) the statement by computer. Hence we omit the quite complicated detailed proof, in which 
many cases have to be distinguished and no new idea is needed. 
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2.2 Negative results 

Theorem 2.22. Let n = 2k with k > 6 integer. Then there exists E, F C Z n such that they are 
not translates of each other, however they have the same 3- deck. 

Proof. Let 

E = {0}U{3,4,...,fc-l}U{A; + l,fc + 2} J and F = {0, 1} U {3, 4, . . . , k - 1} U {k + 2}. 

Since k > 6, both E and F contain a unique block of k — 3 consecutive numbers. Thus if a 
translation takes E to F then this block of E must be taken to the block of F. Since these blocks 
are identical, the translation must be the identity. But E ^ F, so we proved that they are not the 
translates of each other. 

By (|2l. for checking that E and F have the same 3-deck we have to show that for the Fourier 
Transforms of their characteristic function we have 

si + s 2 + s 3 = (mod2fc) =>• Xe(si)x^(s 2 )xe{s 3 ) = Xf(si)xf(s 2 )xf(s 3 ). (13) 

Letting z = = e~ 2nl ik we have 

= + (C 2 ~f + C 2k 4s + • • • + C 2 -f + C 2 - fc (fc+1)s + C 2 ~f +2)s (14) 

= 1 + (z 3 + z 4 + . . . + z k ~ l ) + z k+l + z k+2 = {l-z + z 3 )(l + Z + ... + z k ~ l ), 

and similarly 

Xf(s) = 1 + z + (z 3 + z 4 + . . . + z fe - x ) + z fc+2 = (1 - z 2 + z 3 )(l + z + . . . + z k - v ). (15) 
If s is even but s ^ (mod 2k) then 

l. i z k - 1 e _27ri tf - 1 

1 + Z + . . . + Z k 1 = = — 5-r- = 0, 

z - 1 e " 2?ri 2fc - 1 

and so Xs(s) = Xp(s) = 0. 

Since si + s 2 + S3 = (mod2fc) implies that at least one of si, s 2 and S3 is even, we get that 
(|13ft clearly holds unless at least one of s\, s 2 and S3 is zero. 

So suppose that at least one of si,s 2 and S3 is zero. Then, in order to check (|13[). we have to 
show that 

Xe(s)xe(-s) = Xf(s)xf(-s) (s£Z 2fc ). (16) 

This is just a restatement of the fact that E and F have the same 2-deck, which is clearly true as 
E is a translate of — F. □ 

Theorem 2.23. Let n = pqrd with p, q two distinct primes and r, d > 1 integers. Then there exist 
E, F C 7L n such that they are not translates of each other, however they have the same 3-deck. 



Proof. Let 



A = \ ±- + kd : k € {0, 1, . . . , r - 1}, h € {0, 1, . . . , q - 1} }, 



B = S^y + kd : k £ {0,1,... ,r- 1},1 2 € {0,1,... ,p- 1} 
E = AU(B + 1) and F = A U (J3 + d + 1). 
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Then 



XE(S) 



fr-\ 

E- 

\k=0 



Zi=0 



? +e ' 



p-1 

Z 2 =0 



-27ri- 



if pg|s but pgrfs \g if g [ a) Q if gfs 



and 

Thus 
hence 



'r-\ 



Xf(s) = X/ 



vfc=0 



9-1 

E' 

Ji=0 



-27TJ- 



a + e" 



-2m 



p if p|s, if p\s J 
p-1 



£ e 

z 2 =o 



n ■ ^2 S 
-27T«^- 

P 



Xe(s) <4=> Xf( s ) 7^ <J=^ (p|s or q\s) and (pg/s or pqr\s), 
suppxs = {s£Z„: P|s,g/s} U{s G Z n : g^p/s} U {s G Z n : pgr|s} 



For checking that 2£ and -F have the same 3-deck we have to show that 

si + s 2 + s 3 = O(modn) =>• £b(si)£e(s2)£b(s3) = 0-(si)xf(s 2 )£f( s 3)- 



(17) 



We have nothing to prove unless s±, S2, S3 G suppx^. So suppose that si, S2, S3 G suppx^. 
Note that Xe(s) = Xf(s) unless s G 5 P . Thus if none of s±, S2, S3 are in S p then we are done. 
It is impossible that exactly one of them is in S p (because of divisibility by q). 
If two of them, say si and S2, are in S p then S3 is in S p or in S pqr . In both cases it is easy to 
check (H7J). 

Finally, suppose that F = E + t (mod n). Since both E and F have qr elements that are mod 
d and pr elements that are 1 mod d, t must be of the form t = md. Thus we must have A = A + md 
and B + d = B + md (mod n). But B consists of blocks which are arithmetic progressions of length 
r and step d, and these are regularly spaced at intervals of length qrd. Hence B + d = B + md (mod 
n) can only happen if d — md is a multiple of qrd, or, equivalently, if m = 1 mod qr. On the other 
hand, by the similar structure of A it follows that m = mod pr, which is a contradiction. □ 

2.3 Results about real-valued functions 

Given the results we have proved so far we can also characterize those values of n for which the 
3-deck determines the characteristic function of any nonempty subset of Z n up to translation even 
among all Z n — ► R functions. 

Theorem 2.24. For n > 3 the following three statements are equivalent. 

(i) n is a power of an odd prime or n is the product of at most 3 (not necessarily distinct) odd 
primes. 

(ii) The support of the Fourier Transform of any characteristic function on Z n is an extendable 
domain. 



(Hi) If for some 7^ E C 7L n and g 
translates of each other. 



I, xe o,nd g have the same 3-deck then they are 
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Proof. (i)=^(ii): This is exactly Proposition 12.41 

(ii) =>(iii): If E ^ then xe(0) ^ and so by Lemma l2~3l (2) we get that \E and g are indeed 
translates of each other. 

(iii) =>(i): If n is odd and (i) does not hold then, by Theorem 12 .231 there exists counterexamples 
for (iii), even with g being a characteristic function. 

Now suppose that n > 2 is even and let E = {1, 2, . . . , n/2}. It is easy to check that supp xe = 
{0,1,3,5,... ,n- 1}. Let 

a if I = 1, 
h a (l) = < -a if / = -1, 
otherwise. 

Let g a be the inverse Fourier Transform of the function G a (l) = e 2mha ( l > ■ xe(1) on Z n . Since h a 
is an odd function, G a (—l) = G a (l), and so g a is a real valued function. Since h a is additive on 
SU PPXE) the right hand side of (j3J) holds for k = 3, / and g = g a , and so N XE ^ = N ga ^. This way 
we get continuum many distinct g a : Z n — > R functions. Since bas only finitely many translates 
(iii) cannot hold for every g a . □ 

Example 2.25. Let n > 4 be arbitrary, / = on Z n and g(k) = cos e Z n ). Then clearly 

/ = and one can check that 

'n/2 if Z = l, 
= <| - n /2 if i = -1, 
otherwise. 

Then it is easy to check that the righthand-side of (j3J) holds for k = 3, so Nf$ = N g ^, however / 
and g are clearly not translates of each other. 

This shows that if we allow E = in (iii) of Theorem 12.241 then (i)=>(iii) is not true any more. 



Remark 2.26. It is proved in |.TK| (Proposition 2.7) that if / is the characteristic function of a 
subset of R of finite measure and g £ L X (R) is a nonnegative function such that = N g ^ then 
there g must be equal to a characteristic function almost everywhere. 

One can check that the same proof works on 7L n as well. This has the following consequences. 

1. The characteristic functions on Z n are determined up to translation by their 3-deck among 
nonnegative functions if and only if they are determined up to translation among characteristic 
functions; that is, by Corollary ll.l[ if and only if n is a power of an odd prime or n is the 
product of at most three (not necessarily distinct) odd primes or n £ {2,4,6,8, 10}. 

2. Only the (at most finitely many) characteristic functions can be nonnegative among the 
(continuum many) g a functions of the proof of (iii)=>(i) of Theorem 12.241 



3 The percentage of subsets of Z n not determined by their 3-deck 
up to translation 

As we mentioned in the Introduction, in |RSlj Radcliffe and Scott proved that almost all subsets of 
Z n are determined up to translation by their 3-deck. More specifically they proved that the fraction 
of subsets of 7L n whose Fourier Transform vanishes somewhere is at most C e l l n l l 2 ~ e , for any e > 0, 
and, since any set whose FT does not vanish is uniquely determined from its 3-deck, this proves 
that a fraction at most C t /n 1 ^ 2 ~ e of the possible sets are not determined by their 3-deck. 
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Furthermore, it is easy to see that the probability of having the FT of a random subset of Z n 
vanish somewhere is at least C / \/n. For this one takes n to be even and examines the FT of the 
random set at n/2. The vanishing there is equivalent to a random subset of a set of n/2 ones and 
n/2 minus-ones having a vanishing sum. This probability is equal to ( n " 2 ) /2 n ~ C / y/n. 

However, here we show that the probability that a random subset of Z n is not uniquely deter- 
mined up to translation by its 3-deck is exponentially small ( Theorem I3.4f) . When talking about 
random sets in this section we mean that all subsets of Z n are equally probable. This is the same 
as tossing an independent fair coin for each element of Z n to decide membership in the random set. 

Lemma 3.1. Suppose u±, . . . , u m are vectors in a vector space V and that the collection u\, . . . , ud, 
D < m, are linearly independent. Suppose also that ej, j = l,...,m, are {0, l}-valued random 
variables which are unbiased and independent. Then 



3=1 



< 2- D . (18) 



Proof. Since u\,...,ud are independent, for any fixed €d+i, ■ ■ ■ , e m , the 2 D possible values of 
^2JLi e j u j are an distinct, so only at most one of them can be zero. □ 

Corollary 3.2. If E C Z n is random then 

Pr \x%(k) = 0] < 2~ Cn l i^iogiogn^ 

for some absolute constant C > and for all k £ Z n . 
Proof. Let w = e 2ni / n . Then 

n-l 
3=0 

where the ej, j = 0, . . . ,n — 1, are independent, unbiased, {0, l}-valued random variables. 

It is well known that the algebraic order of oo k over the field Q is <f>(n/(k, n)), where 4>(n) is the 
Euler function which counts how many numbers from 1 to n are coprime ton. It is also well known 
FfW that <j){n) > Cn/loglogn. This means that if P(x) is a polynomial with rational coefficients 
and degree < Cn/(k, n) log log n then P(uj k ) ^ 0. This, in turn, implies that the complex numbers 

l,UJ k ,0J 2k , . . . , u/CVCM) log log ri)-fc 

are Q-linearly independent. Applying Lemma 13.11 to the random sum ()19|) in the vector space C 
over Q we get our result. □ 

Corollary 3.3. // n is odd then the probability that a random subset of 7L n is not uniquely deter- 
mined by its 3-deck is at most 2~ Cn / l ° s ^° sn . 

Proof. We make use of a result of Griinbaum and Moore |GM| (see which states that if n is 
odd, E C Z n , and Xe(1) ^ then E is determined by its 3-deck. The rest follow from Corollary 
CPIwith k = 1. □ 

For arbitrary n we lose a little in the exponent. Probably this is unnecessary. 
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Theorem 3.4. If E is a random subset ofZ n the probability that E is not determined by its 3-deck 
is at most 

2 -C e n 1 - £ 

for any e > 0. 

For the proof we use some notions (recall Definition 12.21 and Notation I2.5|) and lemmas from 
£12.11 and also some new ones. Write 

A x = {k e Z n : (k,n) < x}, 

and write GAP(B) for the size of the largest interval contained in the complement of B C Z n . 

Lemma 3.5. GAP(Aj( n )) < d(n), where d{n) denotes the number of divisors of n. 

Proof. Suppose that / = {a, a + 1, . . . , a + d(n)} C A% n \ is an interval of size d(n) + l, and i,j £ I, 
i ^ j. Then (i,n) > d(n) and (j,n) > d(n). It follows that (i,n) ^ (j,n), otherwise we would have 
\i — j\ > (i,n) > d(n), which cannot happen as all distances in / are at most d(n). Thus, to each 
i £ I there corresponds a different divisor of n, namely (i,n). But this cannot happen as I has 
d(n) + 1 members but there are only d(n) different divisors of n. □ 



Lemma 3.6. If {0, 1, . . . ,d} Cj4cZ„ and GAP(yl) < d then A is an extendable domain. 

Proof. Let h : A — > 1R/Z be an additive function. First by induction we get that h(j) = 
jh(l) (modi) for j = l,...,d. Since GAP(^4) < d, this can be extended by induction to all 
of A □ 

Lemma 3.7. If E C Z n and {1, 2, . . . , d(n)} C suppx~E then E is determined up to translation by 
its 3-deck. 

Proof. By Fact 12. HI {1,2, . . . ,d(n)} C suppxe implies that A# n ) C suppxi;. Thus by Lemma ET31 
GAP(suppx^) < d(n). Hence by Lemma [3.61 suppxi; is an extendable domain. Therefore by 
Lemma 12.31 (1). E is determined up to translation by its 3-deck. □ 

Proof. (Theorem E3J) By Corollary El 

Pr[3jG{l,2,...,d(n)}:xi(i)=0] < d(n)2" C "/ d W lo ^ n 

< C f n £ 2- 

< T 



where e' > is again arbitrary, and we used the fact that d(n) = 0(n e ) for all e > HW . By 
Lemma 13.71 this completes the proof of Theorem 13.41 □ 
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